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1.  Introduction 

This  paper  is  concerned  with  the  diffusion  Halts  of  several  closely 
related  production  planning  probleas.  Each  problea  involves  a  flra  pro¬ 
ducing  a  single  durable  coaaodity ,  Which  it  sells  for  %  dollars  per 
unit.  Production  flows  into  a  finished  goods  inventory,  and  deaand  Which 
cannot  be  aet  froa  stock  on  hand  is  siaply  lost,  with  no  adverse  effect  on 
future  deaand.  With  the  price  x  fixed,  product  deaand  is  viewed  as  an 
exogenous  source  of  uncertainty,  and  very  specific  assuaptlons  will  be  aade 
about  its  stochastic  structure. 

Given  a  fixed  investaent  in  plant  and  equlpaent,  we  consider  the 
problea  of  adjusting  production.  Inventory  and  workforce  levels  as  deaand 
quantities  are  obeerved.  This  is  a  production  smoothing  problea  of  the 
general  type  studied  by  Bolt,  Modigliani,  Muth  and  Simon  (1960).  Simplest 
of  the  several  formulations  to  be  considered  here  la  the  following  two- 
stage  problem  with  lost  sales. 

At  time  zero  the  flra  aust  select  a  work  force  else,  or  equivalently  a 
regular-time  production  capacity.  For  simplicity,  assume  that  the  work¬ 
force  sice  cannot  be  varied  thereafter,  the  flra  being  obliged  to  pay 
workers  at  a  stated  wage  rate  regardless  of  whether  they  are  productively 
eaployed.  Let  k  be  the  capacity  level  selected,  in  production  units  per 
unit  tine.  The  firm  then  incurs  a  labor  cost  of  Ik  dollars  per  unit  time 


ever  afterward,  where  Jl  is  a  specified  constant,  even  if  it  occasionally 


* 


chooses  to  opsrsts  below  full  capacity.  In  this  first  formulation,  over- 
tins  production  is  assumed  to  be  impossible  or  forbidden.  In  addition  to 
Its  lebor  costs,  the  fin  incurs  a  materials  cost  of  ■  dollars  for  each 
unit  of  actual  production.  Given  the  initial  capacity  decision  (workforce 
level),  labor  costs  are  fixed,  and  thus  the  marginal  cost  of  production  is 
■  dollars  per  unit.  Next,  a  physical  holding  cost  of  h  dollars  per  unit 
time  is  Incurred  for  each  unit  of  production  held  in  inventory.  (Thla  doea 
not  include  the  financial  cost  of  holding  inventory.)  Finally,  it  is 
assumed  that  the  fin  earns  Interest  at  rate  a  >  0,  compounded  continu¬ 
ously,  on  funds  which  are  not  required  for  production  operations.  The  firm 
must  choose  a  capacity  level  k  and  then  at  each  time  t  >  0  select  a 
production  rate  from  the  Interval  [0,k].  Its  objective  is  to  minimise  the 
expected  present  value  of  sales  revenues  recelvsd  minus  operating  expenses 
Incurred  over  an  infinite  planning  horison,  where  discounting  is  continuous 
at  interest  rate  a.  When  a  production  rate  below  k  is  selected,  wm 
shall  say  that  undertime  is  being  employed. 

To  specify  the  stochastic  character  of  demand,  let  us  consider  the 
sequence  of  discrete  time  periods  ending  at  epochs  t  ■  1,  2,  ...  .  Let 
(t  denote  the  total  demand  experlencad  during  period  t.  It  is  assumed 
that  {£},  ?2»  •••)  form  a  sequence  of  Independent  and  identically 
distributed  (IID)  positive  random  variables  with 

(1)  E(5t)  -  X  >  0  and  Var(?t)  -  a2  >  0  . 

Furthermore,  as  a  convenient  idealisation,  assume  that  demand  arrives  et  a 


uniform  rate  during  each  individual  period.  Thus,  defining  the  partial 


sums  Sn  ■  +  •••  +  £n  (with  Sq  •  0  by  convention),  the  cueu- 

latlve  demand  up  to  tlee  t  Is 

(2)  D(t)  -  (t-njSn+i  +  (nfl-t)^  If  n  <  t  <  n  +  1  . 

A  picture  of  the  Interpolated  random  walk  D  ■  (D(t)  f  t  £  0}  la  given  In 
Figure  1. 


D(t) 
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Figure  1.  A  Typical  Saaple  Path  of  the  Cumulative  Demand  Process  D 

These  assumptions  rule  out  seasonality,  growth,  and  every  other  sort 
of  secular  trend  In  demand.  It  might  be  argued  that  this  makes  the  produc¬ 
tion  planning  problem  uninteresting,  since  optimal  response  to  such  secular 
trends  Is  the  dominant  issue  in  real  life,  ity  objective  here,  however.  Is 
to  explore  the  potential  role  of  diffusion  models  In  production  and 
Inventory  theory,  starting  with  the  simplest  possible  situation.  When 


certain  basic  principles  have  been  established,  more  realistic  generalisa¬ 
tions  will  naturally  suggest  theaselves. 


The  two-stage  problem  with  lost  sales  will  be  stated  in  precise 
mathematical  terms  in  Section  2.  Fixing  the  demand  process  D,  we  then 
consider  a  sequence  of  cost  structures  in  which 

(3)  e  5  h  +  mat  4-  0  , 

with  the  wage  rate  i  and  the  contribution  margin  c  ■  x  -  m  remaining 
constant.  Under  these  conditions,  it  will  be  shown  that  our.  production 

t 

smoothing  problem  approaches  a  certain  two-stage  optimal  control  problem 
for  Brownian  motion,  which  can  be  solved  explicitly.  The  first  stage  of 
this  limiting  problem  involves  selecting  a  drift  rate  for  an  underlying 
Brownian  motion.  Its  second  stage  is  the  instantaneous  control  problem 
formulated  and  solved  by  Harrlson-Taylor  (1977).  When  the  solution  of  this 
limiting  problem  is  Interpreted  in  terms  of  the  original  production  plan¬ 
ning  problem,  we  arrive  at  the  following  conclusion.  If  e  is  small,  then 
a  nearly  optimal  policy  is  to 

1/2 

(4)  select  capacity  level  k  •  X  +  e  p*,  where  p*  is  an  easily 

computed  constant, 

(5)  use  only  as  much  undertime  as  required  to  keep  the  inventory  level 

-1/2 

below  b*e  where  b*  is  another  easily  computed  constant, 

and  (of  course)  to  forego  potential  sales  only  when  obliged  to  do  so  by 
lade  of  stock.  The  capacity  choice  (4)  creates  a  condition  of  balanced 


[■> 


loading,  moaning  Chat  Cho  full-capacity  production  rota  and  tho  overage 
danond  rata  ora  vary  nearly  equal.  (In  queueing  theory  this  would  he 
called  a  heavy  traffic  condition,  but  the  tern  balanced  loading  toono  no  re 
appropriate  for  production  aystene.)  A  novel  and  Inport ant  feature  of  the 
treatment  given  here  lo  that  no  ouch  oeeunption  la  imposed  a  priori.  Fron 
the  acononlc  aaaunptlon  (3),  It  la  shown  that  optimal  system  design  creates 
a  balanced  loading  condition,  and  this  In  turn  justifies  a  diffusion 
approximation  for  the  subsequent  problem  of  Inventory  control  through  mani¬ 
pulation  of  the  production  rate. 

Readers  will  doubtless  recognize  ma  as  the  financial  cost  of 
carrying  Inventory,  In  dollars  per  unit  of  inventory  per  unit  time,  with 
Inventory  valued  at  Its  marginal  production  cost  of  m  dollars  per  unit. 
Thus  our  sole  assumption  (3)  is  that  the  total  cost  of  carrying  Inventory 
(both  explicit  and  implicit)  is  vanishingly  small  compared  with  the  oppor¬ 
tunity  loss  on  foregone  soles  end  the  coot  of  labor.  This  leads  to  the 
high  tolerance  for  Inventory  manifested  In  (5)  and  the  disinterest  In 
excess  capacity  manifested  In  (4). 

It  was  stated  earlier  that  (4)  and  (5)  constitute  a  nearly  optimal 
policy  when  c  is  small,  but  this  statement  will  not  In  fact  he  justified 
by  a  formal  proof  of  convergence.  By  carefully  developing  a  sequence  of 
equivalent  transformed  problems,  I  hope  to  make  it  clear  how  the  diffusion 
model  amerges  as  c  becomes  small,  without  the  technical  complexity 
required  for  a  rigorous  proof  of  convergence.  It  seems  likely  that  this 
line  of  argument  can  be  extended  to  a  formal  limit  theorem,  and  others  may 
have  some  interest  iu  that  task. 


5 


Section  3  is  devoted  to  a  two-stage  planning  problem  with  overtime. 
This  is  identical  to  the  problem  discussed  above  except  that,  after  the 
regular-tiae  production  capacity  (workforce  level)  has  been  set,  overtlae 
production  is  also  available  at  the  cost  of  a  premium  labor  rate.  He  find 
that  this  problem  is  mathematically  equivalent  to  its  predecessor,  and  thus 
their  diffusion  limits  coincide. 

Section  4  treats  a  more  complex  and  realistic  problem  where  the  work¬ 
force  level  can  be  dynamically  adjusted,  and  all  else  is  as  before. 
(Overtime  production  may  or  may  not  be  available.)  Each  decrease  in  the 
workforce  or  capacity  level  entails  a  proportional  transaction  cost,  and 
the  same  is  true  for  Increases.  Again  we  consider  a  sequence  of  cost 
structures  where  e  =  h  +  mac  +  0  and  all  else  remains  constant.  The 
production  planning  problem  approaches  a  two-dimensional  stochastic  control 
problem  where  one  simultaneously  controls  the  state  and  the  drift  rate  of  a 
Brownian  motion,  subject  to  proportional  transaction  costs  for  each  type  of 
control.  This  limiting  problem  has  not  been  studied  as  yet.  The  prospects 
for  explicit  solution  seem  bright,  however,  since  a  very  similar  stochastic 
control  problem  was  solved  completely  by  Benes-Shepp-Hltsenhausen  (1980). 

In  the  development  of  Sections  2-4,  we  consistently  speak  in  terms  of 
a  fixed  demand  process  D  and  a  family  of  cost  structures  such  that 
e  4  0.  There  is  an  altematalve  Interpretation  for  each  of  our  problems, 
however.  This  involves  a  fixed  cost  structure  and  a  sequence  of  demand 
processes  characterised  by  increasing  average  demand  rates.  This  alterna¬ 
tive  Interpretation  in  terms  of  high  volume  production  systems  will  be 
developed  in  Section  S  for  the  two-stage  problem  with  lost  sales. 


It  Is  assumed  throughout  that  I  >  0,  ■  >  0,  h  >  0,  and  *  >  Jt  +  m. 
Relaxing  any  of  these  conditions  yields  a  degenerate  and  uninteresting 


problem.  When  we  say  that  a  given  stochastic  process  is  a  (p,o)  Brownian 
motion,  this  means  that  the  drift  rate  Is  p  and  the  variance  parameter  Is 
c*. 

2.  The  Two-Stage  Problem  with  Lost  Sales 

To  state  the  problem  in  mathematical  terms,  we  denote  by  U(t)  the 
cumulative  amount  of  undertime  used  over  the  interval  [0,t].  Thus  actual 
production  up  to  time  t  is  kt  -  U(t).  Let  L(t)  denote  the  cumulative 
amount  of  potential  sales  foregone,  or  cumulative  lost  sales,  over  the 
interval  [0,t].  Denoting  by  Z(t)  the  inventory  level  at  time  t,  and 
assuming  for  simplicity  that  Z(0)  *  0,  w  then  have  the  tautological 
relationship  (inventory  ■  cumulative  input  -  cumulative  output) 

(6)  Z(t)  -  [kt  -  U(t)J  -  (D(t)  -  Ut)J,  t  >  0  . 

The  undertime  process  U  ■  (U(t) ,  t  >.  0}  is  of  course  a  manifestation  of 
managerial  policy,  and  we  shall  shortly  specify  the  set  of  processes  U 
that  constitute  legal  policy  choices.  To  symmeterlze  the  statement  of  the 
control  problem,  one  can  also  treat  the  lost  sales  process  L  *  { L( t ) ,  t 
0)  as  a  policy  component,  meaning  that  management  may  specify  the  amount 
of  potential  sales  to  be  sacrificed,  provided  that  this  specification  meets 
certain  constraints.  Given  a  capacity  choice  k,  the  pair  (L,U)  is  said 
to  be  admissible  if 

(7)  L  and  U  are  right  continuous  with  left  limits  (ROLL), 

(8)  L  and  0  are  non-anticipating  with  respect  to  D, 


(9)  L  and  U  are  non-decreaaing  with  L(0)  -  0(0)  -  0, 


(10)  Z(t)  >  0  for  all  t  >  0, 

where  Z  la  defined  In  terms  of  k  and  (L,U)  by  (6).  Condition  (7)  Is 
purely  technical  In  nature,  while  (9)  and  (10)  are  obviously  essential 
physical  restrictions.  The  key  condition  (8)  requ' res  that  any  decision  to 
work  below  full  capacity  or  forego  potential  sales  must  be  based  solely  on 
demand  information  available  at  the  time  of  the  decision.  Physical  consid¬ 
erations  also  suggest  the  restrictions  L(b)  -  L(a)  £  D(b)  -  D(a)  and 
U(b)  -  U(a)  <  k(b-a)  whenever  0  <  a  <  b  <  •.  But  one  finds  that  these 
restrictions  are  always  satisfied  by  an  optimal  policy  even  if  omitted  from 
the  formal  problem  statement.  Thus  they  can  safely  be  ignored. 

In  order  to  state  precisely  the  objective  for  our  control  problem, 
note  first  the  following.  Over  any  time  interval  (a,b]  the  total  revenue 
earned  is  x{[D(b)  -  L(b)J  -  {D(a)  -  L(a)]>,  the  total  labor  cost  incurred 
is  Xk(b-a),  the  total  materials  cost  incurred  is  m{[kb-U(b)]  -  (ka-U(a)]), 
and  the  total  inventory  holding  cost  incurred  is 

b 

h  /  Z(t)dt  . 

a 

Thus  the  expected  present  value  of  revenues  received  minus  operating 
expenses  incurred  over  an  infinite  planning  horizon  is 

m 

(11)  B  /  e”at{x[dD(t)  -  dL(t)]  -  Xkdt  -  m[kdt  -  dU(t)J  -  hZ(t)dt)  =  V  , 

0 


where  the  Integrals  Involving  dD(t),  dL(t)  and  dU(t)  are  defined  path- 
by-path  in  the  Riemann-Stieltjes  sense.  Our  objective  is  to  choose  a 
capacity  level  k  and  then  an  admissible  pair  (L,U)  so  as  to  minimise 

(11) .  Given  k  and  U,  it  will  of  course  turn  out  that  the  optimal  choice 
for  L  elects  to  forego  potential  sales  only  when  this  is  necessary  to 
satisfy  Z(t)  0. 

It  should  be  emphasized  that  the  opportunity  loss  on  capital  tied  up 
in  Inventory  is  fully  accounted  for  by  the  discounting  in  (11),  so  h 
should  include  only  the  direct  or  out-of-pocket  expenses  associated  with 
holding  inventories.  To  put  it  another  way,  no  explicit  financial  cost  of 
Inventory  appears  in  (11),  and  including  any  such  financial  cost  in  h 
would  be  double  counting,  cf.  Problem  2-69  of  Hadley-Whitln  (1963).  It 
will  now  be  helpful  to  derive  an  equivalent  objective  function  in  which  a 
financial  cost  of  Inventory  does  appear  explicitly.  Let 

CD 

(12)  I  -  E  /  e~at(*-JH»)dD(t)  , 

0 

this  representing  the  firm's  expected  present  value  in  the  ideal  situation 
where  units  are  produced  precisely  as  demanded,  with  labor  and  materials 
paid  for  only  when  needed  for  such  production  and  no  inventories  held. 

Using  integration  by  parts  and  the  fact  that  E[D(t)]  -  \t  (this  is  exact 
for  all  t),  we  find  that 


E  ^  e~atdD(t)  -a E  /  e“ocD{t)it 


-  a  /  e“at\tdt 
0 


e_atXdt  , 


and  thus  (12)  can  be  rewritten  as 


(13)  I  -  E  /  e~at{*dD(t)  -  iXdt  -  *dD(t)}  . 

0 


Now  defining  the  excess  capacity 


(14)  n  -  k  -  \  , 

we  see  from  (13)  that  (11)  can  be  rewritten  as 


(15) 


V  -  I  -  A 


where 


(16)  A  -  E  /  e"at{wdL(t)  +  Apdt  +  hZ(t)dt 

0 


+  ml  led  t  -  dU(t)  -  dD(t)J)  . 


Using  (6)  and  (Rleaann-Stieltjes)  integration  by  parts,  we  have 


(17)  /  e"atlkdt  -  dU(t)  -  dD(t) J  -  /  e"at[dZ(t)  -  dL(t)J 

0  0 

-  /  e~st[aZ(t)dt  -  dL(t)J  . 
0 


Thus,  defining  the  contribution  margin 

(18)  c  »  *  -  m  , 
we  substitute  (17)  into  (16)  to  obtain 

05 

(19)  A  -  E  J  e”at{cdL(t)  +  ipdt  +  (W-om)Z(t)dt)  , 

0 

Obviously  A  represents  the  amount  by  which  our  plan  falls  short,  in 
expected  present  value  terms,  of  the  ideal  profit  level  I.  Equation  (19) 
expresses  this  shortfall  in  terms  of  three  distinct  effects.  First,  the 
excess  capacity  p  costs  us  pi.  dollars  per  unit  tine  more  than  the  ideal 
capacity  level  X.  (Note  that  this  component  of  A  may  actually  be 
negative  if  k  is  taken  smaller  than  X.)  Second,  the  contribution  margin 
of  c  dollars  is  lost  each  time  a  unit  of  potential  sales  is  foregone. 
Finally,  for  each  unit  of  Inventory  we  continuously  incur  an  out-of-pocket 
expense  of  h  plus  an  opportunity  loss  of  a  times  the  marginal 
production  cost  m. 

Since  the  demand  process  D  is  uncontrollable,  I  is  a  constant,  and 


thus  our  original  objective  (maximising  V)  is  equivalent  to  minimising 
A.  To  further  transform  the  problem,  let  us  define 


i 


(20) 

e  ■  h  +  net  and  0  ■  a/e  , 

(21) 

*  -  -1/2 

H*  •  . 

(22) 

0*(t)  -  el/20(t/e).  I*(t)  -  e1/2L(t/e)  and 

2*(t)  •  e^2Z(t/e)  for  t  >  0  . 

Making  the  change  of  variable  a  »  et  In  (19),  w  find  chat 


(23)  0e1/2A  -  E  /  0e~^*l iy*da  +  Z*(s)ds  +  cdL*(a)J  s  A*  . 

0 


! 

* 

\ 


Wi 


Obviously,  our  original  objective  ia  equivalent  to  einluizlng  A*,  and  we 
■ay  view  p*  and  (L*,U*)  aa  tha  objecta  of  choice  rather  than  k  and 
(L.U).  To  re-express  the  conatrainta  on  (L,U)  in  convenient  fom,  let  ua 
define 

(24)  X(t)  -  Xt  -  Y(t)  and  X*(t)  -  e1/2X(t/e) 

for  t  _>  0.  The  Inventory  equation  (6)  ia  equivalent  to  Z*(t)  ■  X*(t)  + 
|i*t  +  L*(t)  -  D*(t),  t  <  0,  and  Chua  our  conatrainta  (7)-(l0)  nay  be 
equivalently  expreaaed  aa 

(25)  L*  and  0*  are  ROLL 

(26)  L*  and  U*  are  non-anticipating  with  respect  to  X*, 

(27)  L*  and  U*  are  non-decreasing  with  L*(0)  “  U*(0)  ■  0  , 

(28)  Z*(t)  S  X*(t)  ♦  p*t  +  U(t)  -  U*(t)  >0  for  all  t  >  0  . 

We  aumarlse  the  development  up  to  here  as  follows. 
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(29)  Proposition.  The  original  two-stage  problem  with  lost  sales  is 
equivalent  to  choosing  first  p*  and  then  (L*  ,U*)  so  as  to  minimise  A* 
defined  by  (23),  subject  to  the  constraints  (25)-(28). 

Note  that  the  uncontrollable  process  X*  drives  this  stochastic  control 
problem  through  (26)  and  (28).  If  demand  is  deterministic,  meaning  that 
o*0  in  (1),  then  the  optimal  policy  is  obviously  to  take  k  •  X  (the 
average  demand  rate)  and  U(t)  *  L(t)  -  0  for  t  0.  This  achieves  the 
ideal  profit  level  of  I.  Thus  one  nay  Interpret  the  minimal  value  of  A 
or  A*  as  a  cost  of  stochastic  variability,  in  expected  present  value 
terns. 

As  in  Section  1,  we  now  consider  a  sequence  of  cost  structures  in 

which 

(30)  a  +  0  and  h  ♦  0  but  all  other  coat  date  remain  constant. 

This  of  course  implies  e  t  0,  and  for  the  moment  let  us  further  assume 
that  a  and  h  vanish  in  such  a  way  that 

(31)  h/a  remains  constant,  and  thus  8  =  (h/a  ♦  n)"1  does  as  well. 

Our  several  problem  transformations  have  of  course  been  chosen  with  an  eye 
to  the  fact  that 

(32)  X*  converges  weakly  to  a  (0,o)  Brownian  motion  as  c  ♦  0 
(Donsker's  Theorem), 


cf .  Billingsley  (1968),  page  68.  Thus,  Che  natural  diffusion  spproxinstlon 

for  our  production  smoothing  problem  is  found  fay  taking  X*  to  be  s  (0, <j) 

Brownian  notion  in  (23)  end  (25)-(28).  Taking  $  to  be  a  fixed  positive 

constant  in  accordance  with  (31),  let  us  now  consider  that  limiting 

problem.  After  the  excess  capacity  level  (or  drift  rate)  p*  has  been 

chosen,  one  is  left  with  the  instantaneous  control  problea  solved  by 

Harrison-Taylor  (1977)  and  later  generalized  by  Harrlaon-Taksar  (1982). 

(The  tern  Instantaneous  control  la  introduced  in  the  latter  paper.)  Given 

s  fixed  but  arbitrary  drift  rate,  the  optimal  policy  (L*,U*)  enforces  a 

lower  reflecting  barrier  at  zero  and  an  upper  reflecting  barrier  at  b*, 

where  b*  Is  the  unique  solution  of  a  certain  transcendental  equation. 

This  means  that  L*  increases  in  the  minimal  amounts  necessary  to  insure 

Z*  0,  while  0*  Increases  In  the  minimal  amounts  necessary  to  Insure  Z* 

<,  b*.  In  terms  of  our  original  problem,  the  latter  constraint  is 
1/2 

expressed  as  c  2  b*,  which  is  id  accordance  with  (5).  The  optimal 

barrier  height  b*,  and  thence  the  minimal  objective  value  A*,  are  func¬ 
tions  of  the  drift  rate  p*  selected  initially;  one  of  course  wishes  to 
choose  p*  so  that  A*  is  minimized.  The  algebraic  expression  for  A*  in 
terms  of  p*  is  complicated  enough  to  make  this  a  difficult  calculus 
problem,  but  numerical  solution  for  the  minimizing  p*  value  Is  of  course 

trivial.  In  terms  of  the  original  problea  statement,  one  wants  to  choose 

1/2  1/2 
excess  capacity  level  p  ■  e  p*,  or  capacity  level  k  ■  X  +  t  p*,  as 

stated  earlier  In  (4). 

The  question  naturally  arises  whether  (31)  Is  the  only  interesting 


condition  regarding  the  relative  nagnltude  of  physical  versus  financial 
costs  of  holding  inventory.  Since  8  1*  bounded  above  by  1/a,  It  seems 


to  m  that  the  only  other  Interesting  condition  Is 

h/a  ♦  •  end  hence  P  ♦  0  es  e  ♦  0  , 

meaning  thet  a  vanishes  fester  then  h  end  hence  the  physical  coats  of 

holding  inventory  eventually  doalnate  the  financial  costs*  This  causes  the 

Interest  rate  In  our  transformed  objective  (23)  to  vanish,  which  presumably 
leads  to  the  Instantaneous  control  problem  of  Harrlson-Taylor  (1977)  with  a 
minimum  long-run  average  cost  criterion*  This  problem  has  not  been 
analyzed  in  the  literature,  but  it  is  obviously  tractable  and  nay  bs 
substantially  simpler  than  its  discounted  analog. 

3.  The  Two-Stage  Problem  with  Overtime 

Suppose  now  that  the  firm  can  obtain  unlimited  amounts  of  instan¬ 
taneous  overtime  production  at  a  premium  labor  cost  of  p  dollars  per  unit 

of  production.  In  order  to  get  an  interesting  problem,  we  assume  l  <  p  < 
n-m.  The  firm  then  prefers  to  use  overtime  rather  than  lose  sales,  but  it 
has  no  motivation  to  use  overtime  except  as  required  to  avoid  lost  sales* 
Having  selected  a  capacity  level  k,  we  are  then  left  with  a  problem  of 
Inventory  control  through  usage  of  overtime  and  undertime  production. 
Formally,  this  is  identical  to  the  problem  treated  in  Section  2  except  that 
now  L(t)  is  interpreted  as  the  cumulative  amount  of  overtime  production 
used  up  to  time  t,  and  c  (the  lost  contribution  msrgin  on  sales 
foregons)  must  bs  rsplaced  by  p. 

Complicating  things  a  bit,  suppose  that  overtime  production  can  only 
bs  achieved  at  a  finite  rate,  and  that  this  rate  may  not  exceed  6k 


(0  <  6  <1)*  If  6  ■  0.2,  for  example,  this  would  wean  that  overtime  pro¬ 
duction  during  any  period  cannot  exceed  20%  of  regular-time  capacity.  When 
using  both  regular-time  and  overtime  production  in  the  maximum  allowable 
amounts,  the  firm's  inventory  dynamics,  ignoring  lost  sales  and  undertime, 
and  then  given  by 

(34)  dZ(t)  -  ( l+6)kdt  -  dD(t) 

■  Xdt  +  pdt  +  k6dt  -  dD(t) 

■  dX(t)  +  pdt  +  k6dt  . 

In  terms  of  the  scaled  quantities  Z*(t)  •  e1^Z(t/e),  X*(t)  ■  e*^X( t/e) 
—1/2 

and  p*  «  pc  Introduced  in  Section  2,  we  can  equivalently  express  (34) 

as 

-1/2 

(35)  dZ*(t)  -  dX*(t)  +  p*dt  +  (kfic  17  )dt  . 

For  small  values  of  e,  this  means  that  by  using  overtime  at  the  maximum 
permissible  rate,  one  can  effectively  achieve  Instantaneous  upward  dis¬ 
placements  in  the  scaled  Inventory  process  Z*.  As  e  vanishes,  the  rate 
restriction  on  overtime  production  ceases  to  be  a  significant  features  of 
the  problem,  and  we  are  reduced  to  the  situation  described  in  the  first 
paragraph  of  this  section. 

4.  Dynamic  Adjustment  of  Cspacity 

Let  us  return  to  the  problem  of  Section  2  (no  overtime  production 
allowed),  altered  by  the  assumption  that  an  Initial  capacity  level  k(0) 
is  specified,  and  that  this  can  be  varied  over  time  at  the  expense  of 


certain  workforce  smoothing  coete.  For  simplicity,  assume  that  k(0)  *  X 
and  that  a  smoothing  cost  of  q6  Is  Incurred  for  either  an  increase  or  a 
decrease  of  size  6  in  the  capacity.  (This  assumption  of  symmetric  coots 


Is  made  only  to  simplify  notation.  The  general  case  mill  be  discussed 
shortly.)  Denoting  by  k(t)  the  capacity  level  at  time  t,  the  expected 
present  value  of  labor  costs  plus  smoothing  costs  Is  then  given  by 


(36)  E  /  e"at{lk(t)dt  +  q|dk(t)|)  , 

where  / |dk(t ) |  represents  the  total  variation  of  k( •).  Setting 
p(t)  -  k(t)  -  X  In  the  obvious  way,  we  observe  that  p(0)  -  0  and 
|dk(t)|  -  |dp(t)|,  so  (36)  can  be  rewritten  as 

flft 

(37)  E  ^  e-atUXdt  +  J4»(t)dt  +  q|dp(t)|)  . 


Let  U(t) ,  L(t)  and  Z(t)  be  defined  as  in  Section  2.  Then  generalize 
(21)  to 


p*(t)  -  p(t)e 


t  >  0  , 


and  let  the  scaled  processes  U*,  L*  and  Z*  be  defined  by  (22)  again. 
Both  the  original  statement  and  the  appropriate  transformations  of  our 
current  problem  are  precisely  analogous  to  those  developed  in  Section  2,  so 
the  obvious  steps  will  be  skipped.  In  the  end,  we  arrive  at  the  problem  of 
choosing  a  scaled  excess  capacity  process  p*  -  (p*(t),  t  £  0)  and  a  pair 
(L*,U*)  so  as  to  minimise 
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I  ^  Pe*’**{A|»*(s)da  +  Z*(a)ds  +  cdL*(a)  +  q|d|i*(s)|} 


aubjacfc  to  tha  conatrainta 


(40)  p*,  LA  and  U*  ara  KCLL, 

(41)  |i*,  L*  and  0*  ara  non-ant lclpat lng  with  raapact  to  X*, 

(42)  L*  and  U*  ara  non-decreasing  with  L*(0)  *  0*(0)  -  0, 

t 

(43)  Z*(t)  s  X*(t)  ♦  /  p*(s)da  +  L*(t)  -  U*(t)  >0  for  all  t  >  0  . 

0 


In  (39)-(43)  we  ara  of  couraa  defining  p  •  a/e  and  X*(t)  ■  e*^2X(t/e) 
1/2 

■  e  [Xt/c  -  Y(t/e)]  exactly  aa  In  Section  2.  Again  wa  Imagine  a 
sequence  of  cost  structures  with  e  4  0  and  all  alas  remaining  constant. 
Invoking  Donsker's  Theorem,  wa  conclude  that  the  natural  diffusion 
approxmatlon  for  ( 39)— (43)  la  obtained  by  replacing  X*  with  a  (0,o) 


Brownian  motion.  This  will  hereafter  be  called  tha  limiting  problem,  and 
|i*(t)  will  be  referred  to  as  a  drift  rata  rather  than  an  axceaa  capacity 


level. 


For  tha  limiting  problem,  tha  state  of  tha  system  at  time  t  J>  0  la 
adequately  summarised  by  tha  current  drift  rata  p*(t)  and  tha  currant 
Inventory  level  Z*(t).  Thus  tha  relevant  state  space  for  this  stochastic 
control  problem  la  tha  half  plana 


S  -  {(p*,Z*)  i  Z*  >  0) 


Figure  2.  Conjectured  Fom  of  Optimal  Policy  for  the  Limiting  Problem 

pictured  in  Figure  2.  In  the  absence  of  external  control,  p*  remains 
constant  and  Z*  evolves  as  a  (p*,o)  Brownian  motion,  meaning  that 
movement  is  constrained  to  a  horisontel  line  in  Figure  2.  The  controller 
can  effect  instantaneous  changes  in  the  value  of  p*  at  a  cost  of  q  per 
unit  of  change  (either  upward  or  downward).  Also,  he  can  instantaneously 
Increase  Z*  at  a  cost  of  c  per  unit  of  increase,  and  can  instantane¬ 
ously  decrease  Z*  without  cost.  Finally,  runnings  costs  ere  continuously 
incurred  at  rate  Z*(t)  +  ip*(t).  From  the  development  in  Section  2  of 
Harrison-Taylor  (1977),  readers  will  see  that  this  problem  is  equivalent  to 
one  having  no  running  costs  (or  holding  costs)  associated  with  Z*  but  e 
positive  reward  associated  with  decreases  in  Z*  enforced  by  the 
controller.  In  the  discussion  to  follow,  however,  m  shall  continue  to 
speak  in  terns  of  the  cost  structure  embodied  in  the  ulnlnand  (39). 


Itcauu  Its  state  descriptor  is  two-diaenslonal,  our  lieiting  stochas¬ 
tic  control  problea  looks  very  difficult,  but  the  potential  saving  grace  is 
that  changes  in  p*  (noveeent  in  the  vertical  dlaension  of  Figure  2)  occur 
only  as  a  result  of  exogenously  lnposed  controls.  Put  another  way,  randoa 
disturbances  only  affect  the  Z*  coaponent  in  Figure  2.  In  this  regard, 
our  problea  is  like  the  finite-fuel  follower  problea  solved  explicitly  in 
the  beautiful  paper  by  Benes-Shepp-Witsenhausen  (1980).  Looking  at  the 
results  of  that  analysis  and  of  Harrlson-Taylor  (1977),  one  is  led  to  con¬ 
jecture  an  optlaal  policy  of  the  fora  pictured  in  Figure  2.  Here  we  have  a 
four-sided  control  region  R  (cross-hatched  in  the  figure),  and  no  action 
is  taken  so  long  as  the  state  of  the  systea  reaalns  within  R.  Rightward 
displaceaent  of  Z*  (lost  sales)  is  used  to  create  a  reflecting  barrier  on 
the  left  side  of  R,  downward  displaceaent  of  p*  (capacity  reduction)  is 

used  to  create  a  reflecting  barrier  on  the  upper  side  of  R,  leftward  dis¬ 

placeaent  of  Z*  (undertlae)  is  used  to  create  a  reflecting  barrier  on  the 
right  side  of  R,  and  upward  displaceaent  of  p*  (capacity  increase)  is 
used  to  create  a  reflecting  barrier  on  the  lower  side  of  R.  In  each  case, 

the  tera  reflecting  barrier  naans  that  the  control  in  question  is  eaployed 

in  the  alnlaal  aaounts  necessary  to  Insure  that  the  process  [Z*(t),p*(t)J 
does  not  cross  over  its  corresponding  boundary  section.  (The  paper  by 
Benes-Shepp-ffltsenhauaen  contains  a  lengthy  discussion  of  such  reflecting 
barriers.)  If  one  starts  at  the  origin  (p*  ■  Z*  «  0)  and  uses  the 
particular  control  region  pictured  in  Figure  2,  then  the  controlled  process 
(Z*,p*)  win  never  leave  the  axis  p*  -  0.  To  prove  that  an  optlaal 
policy  has  the  fora  pictured  in  Figure  2,  and  to  deteraine  the  control 
surfaces  explicitly,  is  certainly  not  an  easy  problea,  but  it  aay  just  be 
within  the  reach  of  currently  available  techniques. 


If  overt iae  production  in  allowed  at  any  given  capacity  level,  one 
arrives  at  the  a awe  formal  problem,  with  L(t)  now  Interpreted  as  cumula¬ 
tive  overtime  used  up  to  time  t,  just  as  in  Section  2.  If  there  are 
different  proportional  costs  associated  with  increasing  and  decreasing  the 
capacity  level,  then  notation  gets  more  complicated,  but  all  the  ideas  are 
the  same.  One  must  represent  k(t)  as  the  difference  of  two  non-decreas¬ 
ing  processes,  say  k(t)  ■  A(t)  -  B(t),  representing  cumulative  capacity 
Increases  and  emulative  capacity  decreases  respectively.  The  last  term  in 
(36)  is  then  replaced  by  two  terms,  one  involving  dA(t)  and  the  other 
involving  dB(t).  In  the  limit  problem,  this  of  course  results  in  differ¬ 
ent  costs  associated  with  upward  and  downward  displacement  of  p*. 

5.  High  Volume  Systems 

For  ease  of  exposition,  let  us  assume  throughout  this  section  that  the 
phyeicel  holding  cost  h  is  sero.  Ostensibly,  the  analysis  of  Section  2 
involves  a  fined  demand  process  and  a  vanishing  Interest  rate,  but  another 
important  interpretation  is  available.  After  redefining  the  units  in  which 
production,  time  and  coat  were  to  be  measured,  we  arrived  at  the  equivalent 
mlaimand 

(44)  B  j  lp*ds  ♦  Z*(s)ds  +  cdL*(s)J  s  &  . 

In  terms  of  these  units,  the  Interest  rate  is  0,  which  we  assume  constant, 

1/2 

and  the  cumulative  demand  process  D*(s)  I  c  D(s/c)  has  the  form 


(45) 


D*(s)  •  A*s  +  X*(s), 


s  >  0 


9 


there  X*  =  Xe**^^  and  X*  is  defined  as  before.  As  a  consequence  of 
our  assumptions,  we  have 

(46)  X*  +  •  and  X*  converges  weakly  to  a  (0,o)  Brownian  notion. 

For  an  alternate  interpretation  of  the  entire  development,  one  nay 
accept  as  natural  the  units  of  measurement  in  (44),  fix  the  interest  rate 
6,  and  directly  hypothesize  a  family  of  demand  processes  of  the  form  (45)- 

(46) .  Such  a  family  displays  a  constant  degree  of  stochastic  variability 
around  an  ever  increasing  average  demand  rate  X*.  With  the  linear  cost 
structure  hypothesized  in  Section  2,  we  conclude  that  for  large  values  of 
X*,  a  nearly  optimal  policy  is  to 

(47)  set  the  production  capacity  at  X*  +  p*,  and 

(48)  use  undertime  as  necessary  to  keep  the  inventory  level  below  b*, 

where  p*  and  b*  are  computed  as  in  Section  2.  A  key  point  is  that  p* 
and  b*  are  constants  (do  not  depend  on  X*).  Thus  as  X*  grows,  (47) 
leads  to  an  increasingly  well-balanced  system,  and  average  Inventory  is  a 
smaller  and  smaller  fraction  of  sales  volume  by  (48). 

For  all  intents  and  purposes,  the  policy  recommendation  (47)-(48), 
with  p*  and  b*  computed  as  in  Section  2,  amounts  to  a  proposal  that 
cumulative  demand  be  modeled  as  a  Brownian  motion  with  drift  X*  and  vari¬ 
ance  o.  It  is  Important  to  recognize  that  this  recommendation  hinges 
critically  on  the  assumption  that  X*  is  large.  If  X*  is  moderate  rela¬ 
tive  to  0,  there  is  no  reason  to  believe  that  a  (X*,o)  Brownian  motion 
can  provide  a  good  approximation  for  the  non-decreasing  cumulative  demand 


process. 
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Abatraetx^  Vfe  consider  the  diffusion  Units  of  several  closely  related 
production  planning  probleas.  Each  Involves  a  make-to-stock  producer  who 
faces  I ID  demands  over  a  sequence  of  future  periods.  In  the  simplest 
formulation,  a  production  capacity  or  workforce  level  must  be  fixed  at  time 
zero,  and  thereafter  the  actual  production  rate  is  adjusted  dynamically  In 
response  to  Inventory  fluctuations.  The  capacity  decision  fixes  certain 
operating  costs  and  constrains  subsequent  decisions  regarding  production 
rates.  Fixing  the  demand  process,  we  consider  a  sequence  of  cost  struc¬ 
tures  in  which  the  total  inventory  carrying  cost  approaches  zero.  (This 
requires  that  both  the  physical  cost  of  carrying  inventory  and  the  Interest 
rate  earned  on  external  Investment  vanish.)  Under  this  condition,  the  pro¬ 
duction  planning  problem  approaches  a  two-stage  optimal  control  problem  for 
Brownian  motion.  The  first  stage  of  the  limiting  problem  involves  drift 
rate  selection  for  a  Brownian  action,  and  its  second  stage  is  the  instan¬ 
taneous  control  problem  formulated  and  solved  by  Harrlson-Taylor  (1977). 
With  small  holding  costs,  we  find  that  an  optimal  capacity  decision  calls 
for  near  equality  of  the  average  production  and  demand  rates,  which  in  turn 
justifies  a  diffusion  approximation  for  the  subsequent  problem  of  inventory 
control  through  production  rate  adjustment. <A  novel  and  important  feature 
of  this  analysis  is  that  no  assumption  of  system  balance,  or  heavy  traffic, 
is  imposed  a  priori.  Instead,  it  is  shown  that  pot lmal  system  design  will 
create  such  balanced  loading  under  certain  economic  conditions.  Under  the 
same  assumption  of  small  holding  costs,  a  product! :  ^planning  problem  with 
dynamic  capacity  adjustment  is  shown  to  yield  a  more  Complex  diffusion 
limit,  which  has  not  been  studied  as  yet.  Finally,  it  1#  shown  that  our 
asymptotic  analyses  apply  equally  well  tv  a  sequence  of  production  planning 
probleas  with  fixed  cost  structure  and  increasing  average  demand  rate. 
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